Replacing Quantum Feedback with Open-Loop Control and Quantum Filtering 
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Feedback control protocols can stabilize and enhance the operation of quantum devices, how- 
ever, unavoidable delays in the feedback loop adversely affect their performance. We introduce a 
quantum control methodology, combining open-loop control with quantum filtering, which is not 
constrained by feedback delays. For the problems studied (rapid purification and rapid measure- 
ment) we analytically derive lower bounds on the control performance that are comparable with the 
best corresponding bounds for feedback protocols. 

PACS numbers: 03.65.Yz,42.50.Dv,42.50.Lc,02.30.Yy 
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Open-loop control and feedback control are gener- 
ally perceived to be distinct but complementary control 
methodologies [l[ . Open- loop control is usually indepen- 
dent of measurement while feedback control, of course, 
involves measurement. Both types of control are pow- 
erful experimental and theoretical tools in classical and 
quantum contexts. In the quantum setting, open- loop 
methods have, for example, allowed: the calculation of 
bounds on gate complexity in quantum logic 2] and op- 
timal gate synthesis [s]; and decoherence suppression by 
bang-bang control and dynamical decoupling j^] . Equally 
impressive progress has been made in feedback control 
theory: the preparation of squeezed states of light and 
spin Q; stabilization of pure and entangled states Q; 
continuous error correction 0]; and precision metrology 
and hypothesis testing Excitingly, these and other 
theoretical advances in quantum control are being real- 
ized in experiments [lo| . 

In spite of these successes there are significant chal- 
lenges facing the field, in particular, those in quantum 
feedback control stemming from delays in the feedback 
loop. When such delays are larger than the relevant 
system timescales, the controllability of the system is 
severely degraded ^11]- In Fig. [T] we depict important 
sources of delays for each component in the feedback 
loop. Typical dynamical timescales (tWs) in the relevant 
quantum systems are 10~^ to 10~^s [l2|. In some experi- 
ments the reciprocal detector bandwidth (rdct) and elec- 
tronic delays dominate the total effective feedback delay 
Tdei [lo| : in others, the time taken to calculate the con- 
ditional state (rfii) and the optimal control (rctri) will be 
most important. Currently, many atomic feedback exper- 
iments are limited by the response time of the actuator 
(Tact), such as usually an electro-optic- modulator [l3| . 
but in solid state systems. Tact is typically small com- 
pared to the other time scales [ij] . In the near future, as 
actuator band widths improve, the field of quantum feed- 
back control will be placed in an awkward position: even 
if Tact ^ Tgys, it may be impossible to perform effective 
feedback control because rdci ^ Tgys. 

In this Rapid Communication we introduce a type of 
quantum control which is a hybrid of techniques from 
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FIG. 1: (color online). A schematic of important time scales 
in a feedback loop. For devices, the times depicted are the 
reciprocals of the component bandwidths. The r^i's are elec- 
tronic delays between devices. The total effective delay is the 
sum of ah the red terms: Tdei = J2i t^i + Tdet + rm + Tcui- 



open-loop and feedback control, and that is not limited 
by feedback delays (or at least is considerably less so). 
The control objectives we consider include rapid state 
purification 15 1, rapid state measurement [l6l. l2f 



and 

rapid state preparation [17[. Our proposal is to apply 



open-loop control to the system over some time inter- 
val [0,T] (with T ^ Tgys), while also continuously mon- 
itoring it. With the resulting measurement record, one 
may perform filtering (calculating the conditioned state 
[EI3) either in parallel to the strategy, or 'offline' (after 
time T). Offline filtering is suitable for objectives like 
rapid measurement and purification, which require no 
feedback at all. Filtering in parallel (requiring Tdei ^ T) 
may be necessary for the objective of rapid cooling or 
state preparation, which in our scheme entails perform- 
ing a single control step after time T. In all cases, by 
combining continuous conditioning and open-loop con- 
trol we obtain results comparable to those previously 
derived for measurement-based quantum feedback. Our 
methodology is distinct from control based on: quan- 
tum back-action [l9| . the quantum anti-Zeno effect |2(| , 
learning (21;], or coherent feedback ^22,] . 

This Rapid Communication is organized as follows. 
First, we briefly review continuous measurements and 
quantum filtering. Next we examine the problem of 
rapid purification under a random-unitary control strat- 
egy. We then consider the rapid measurement control 
problem, with the unitary controls restricted to the per- 



2 



mutation group. In both cases we prove analyticahy that 
the scahng of the speed with the dimension of the sys- 
tem is the same as in the feedback-control strategies of 
Refs. [Hill]. We numerically examine the effect of vary- 



ing St, the time between control pulses, and find that a 
speed-up can persist even with St ^ Tgyg. We conclude 
with a discussion of some implications for quantum con- 
trol, and open questions. 

Quantum Filtering. — Consider a Z?-dimensional quan- 
tum system undergoing a continuous measurement of an 
observable X. The change to our state of knowledge of 
an individual system, p, conditioned on the result of the 
measurement in an infinitesimal interval is described by 
the stochastic master equation (SME) [l|, [i^l 



dp[t;X] = 2-f dtV [X] p{t) + ^2jdw{t)n[X]p{t), (1) 

where V[A]p= ApA^ - Ap + pA^ A) and 'H[A]p = 
Ap + pA^ — Tr [(A^ -I- A)p\ p. We are working in a frame 
that removes any Hamiltonian evolution. The measure- 
ment strength, 7, determines the rate at which informa- 
tion is extracted. The measurement result in the interval 
[t,t + dt) is dR = y/ij{X{t))dt + dw{t), where dw is a 
Wiener process and {X{t)) — Tt [X p{t)]. Without loss 
of generality we take X to be traceless. We can do this 
because Eq. ((T|) is invariant under X ^ X + XI ioi X G R. 

We wish to combine this conditional evolution with an 
open-loop control strategy which comprises applying a 
sequence of unitaries Uq at times tq = to + qSt. Such a 
"stroboscopic" strategy, requiring arbitrarily strong con- 
trol Hamiltonians, is also used in bang-bang control 
for example. This modifies the above quantum filter- 
ing equation as follows. Define U{t) for any t > tQ a.s 



U„ 



U2U1 for tq <t < tq^ 



Working in the Heisenberg 
picture with respect to the control unitary, the moni- 
tored observable at time t is rotated from X(to) = X 
to X{t) = W {t)XU{t). Thus the conditional increment 
of the system in interval [t,t + dt) is simply dp[t; X{t)]. 
To use the information in the measurement record, the 
SME must be integrated as part of the experiment, but 
as noted above, this can happen 'off-line'. 

First application: Rapid Purification. — Pure states are 
necessary for many quantum information protocols. Mo- 
tivated by this, Jacobs 2J| introduced the following con- 
trol goal: reducing the average of L{t) = 1 — Tr [p(t)^] 
(the impurity of the conditional state), to a fixed small 
value in the minimum time, using arbitrary Hamiltonian 
control of the system. In Ref. [I3 this was studied for 
a i'-dimensional system with X, the monitored observ- 
able, being J^. It was shown that, by applying time- 
dependent controls to ensure that the conditional state 
is always unbiased with respect to the measurement ba- 
sis, the rate of purification can be increased by a factor of 
at least + over the no-control case. This control of 
course requires a feedback loop, as it depends on the con- 
ditional state, and hence may be difficult or impossible to 



implement because of feedback delays. Here we find an 
open-loop strategy that works almost as well: applying 
random unitaries. The intuition as to why this works is 
as follows. The feedback of Ref. [l5| maximizes the co- 
herences of p{t) in the measurement basis, and applying 
random unitaries also creates such coherences. By con- 
trast, in the no-control case, the coherences remain zero 
(or decay exponentially if they are initially non-zero). 

To calculate analytically how the continuous measure- 
ment with random-unitary controls work, we make a sim- 
plifying approximation, that St ^ 7"^ = Tsys- That is, 
the controls are applied frequently on the characteristic 
system evolution time. This enables us to treat the evolu- 
tion from tk to tk+i as an infinitesimal change described 
by Eq. ([T]) with X — > X{tk). Dropping the discrete time 
indices, we simply calculate the infinitesimal increment 
dL from Eq. ^ with X X{t) = U\t)XU{t), assum- 
ing U (t) to be a different random unitary at every time. 
Using the Ito calculus, we find E [dL], the change in the 
impurity, averaged over the measurement noise dw, to be 

E [dL{p, X)] = -87{Tr [XpXp] - 2Tr [Xp] Tr [Xp^] 

+ Tr[Xp]^Tr[p2]}di. (2) 

Since U{t) is drawn at random from the unitary group 
ii{D), we perform a further average over that group: 



E[E [dLip)]] 



U(D) 



dWE [dL{p, U^'XU)] 



(3) 



where dU is the Haar probability measure on ii{D) [25|. 
From the structure of Eq. it can be shown that it is 
not necessary to average over all unitaries; any finite set 
comprising a unitary 2-design is sufficient [iBJ. This not 
only simplifies the calculation below; it will also simplify 
implementation of this control strategy as only a finite 
number of different unitaries need be applied. 

We evaluate Eq. ^ using the methods of 
Ref. [25]. We show this explicitly for the term 
Ti = Tr [XUpWXUpW] arising from the first term 
inside the braces of Eq. ([2]). First we enumerate some 
preliminary identities, (i) A permutation operator can 
be defined, using the Einstein summation convention. 
For example, / = P1234 = » |j)01 ® |fc)(fc| (g) |/)(/| 
and P2341 = «) \k}{j\ (g) \l}{k\, where 

the indices run from to D — I. (ii) Using this, 
Tr [ABCD] = Tr [{A (g) B (g) C (g> D)P23ii]. (in) Defining 
Q' = J dU U g) <S) U g) U\ we find (applying the 
necessary permutations to Eq. (5.17) of Ref. [25[) that 
Q' = [D{P2U3 + P4321) - (P4123 + ^"2341)] /DiD^ - 1). 

Returning to Eq. ([3]), the required integral of Ti is 

J dUTi = Tt[{X (X) p(x)X g)p).Q'.P23ii] (4) 
= Tr[{X(g}p(g}X(E>p). {£'(Pi432 + P3214) 

-{Pl234 + P3412)}]/D{D^-1). (5) 
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As an example, we show how to evaluate the second term 
from this expression: Tr [{X (g) p (g) X (g) p).(£'P32i4)] = 
D{k\X\i){j\p\j){i\X\k){l\p\l) = DTr[X^]. Calculating 
the remaining terms in Eq. ^ in like manner gives 



J dUTi = Tr [X^] {D - Tr [p^]) /D{D^ - 1) 



(6) 



A similar calculation must be performed for all terms in 
Eq. ([3]). The final resuh is 

E[E [dL]] = -^^M^di {l - 2Tr [p^] + Tr [p^]'} . 

This differential equation cannot be solved exactly be- 
cause the right-hand-side contains higher-order moments 
of p. However we are interested in the the long-time limit, 
when p is very pure. Defining the largest eigenvalue of p 
to be 1 — A, we have L ^ 2A and also B ^ 2A, where B 
is the factor in braces on the right-hand-side. Thus for 
small target impurities we have 



L[E [dL]] 



--D ^dt {2A} 



-D^dtL, (7) 



where we have chosen X = as in Ref. 15^, giving 
Tr [X^] = D{D^ - 1)/12. In fact, for all p, L < B, so 
that E[E [L]] is bounded above by ex.p{-^Dt)L{0). 

Now we compare this strategy to continuous measure- 
ment without control, in order to quantify the improve- 
ment it provides. Our figure of merit is the speed-up: 
the time it takes the no-control E [L] to reach a fixed im- 
purity divided by the time it takes the above E[E [L]] to 
reach that same impurity 2J]. For the no-control case, 
E [L{t)] (X exp (— 7^) for long times [ll]. Thus the asymp- 
totic speed-up is S — ^D. This is almost the same as 
the S = ^{D + 1) found for the feedback algorithm of 
Ref. [l^. We confirm this high purity result with quan- 
tum trajectory simulations in Fig. [2] We see that the ran- 
dom unitary strategy quickly approaches the predicted 
asymptotic speed-up even for unitaries that are applied 
moderately frequently {5t = 0.0l7^^). Moreover, signifi- 
cant speed-ups are obtained even for St = 7"^. 

To conclude this section, we explain how this protocol 
can be modified for state preparation. After purifying a 
state to a desired level of purity by the method above 
we apply one more unitary. This unitary is necessarily a 
conditional unitary, as it must take the post-purification 
state to the final target state. In effect we have delayed 
the feedback to the final unitary. 

2nd application: Rapid Measurement. — Many quan- 
tum information tasks involve measurement, including 
readout, measurement-based computation, error correc- 
tion, and tomography. This motivates our second control 
goal: to minimize the average time (T) required to find 
out which eigenstate of the observable X the system oc- 
cupied at time to , with a given confidence [l6| . For a con- 
trol strategy that maintains p in the measurement basis. 




Target Impurity 

FIG. 2: (color online). The purification speed-up provided by 
the random unitary strategy for _D = 4. The solid curve is 
a lower bound on the speed-up in the limit where the time 
St between unitary controls goes to zero, as explained below 
Eq. (O, and the dashed line is its asymptotic (high- purity) 
limit. The circles, squares and triangles are numerical calcu- 
lations of the speed-up with finite St = 0.01, 0.25 and 1 (in 
units of the reciprocal measurement rate) respectively. 

it was shown in Ref. fi^ that a good proxy measure of 
the asymptotic reduction in (T) is the reciprocal of the 
speed-up, as defined in the preceding section, but with 
the impurity L replaced by the log infidelity In (A) (where 
A is as defined above). In Ref. [IQ] a speed-up of 8(-D^) 
27| was shown for X — Jz using control-unitaries drawn 
from the permutation group *P(I?) (in the measurement 
basis) according to a locally optimal feedback algorithm. 
Here we again eschew feedback, and consider an open- 
loop unitary U{t) given by C/g . . . U2U1 for tq <t < tq+i, 
where for aU q, Uq G ^(D). 

To obtain an analytical approximation for the speed- 
up we follow the method used above of treating St as 
infinitesimal. Explicitly averaging over all permutations, 
the increment E[(ip] is given by 

Y: \^dtv[pjzP] + Mdu.(^^n[pjzP] 

where we have defined Dl independent Wiener incre- 
ments. It is straightforward to show that this equals 
Efjo' {^^dtHV[n,] + ^2^dw,n[n,]}p, where H, = 
\i){i\ and H = D{D + 1)/12. The equation of motion 
for the populations in the measurement basis is thus 

E[dp,] ^ 2^/2^{dw,ip,-pf)~p,Y,Pjdwj}. (8) 

Taking pq to be the largest population, we use the ltd cal- 
culus to calculate the average change in the log-infidelity: 



E[E[dln(A)]] = -{dpof/2{l-pof 



(9) 



This is easily evaluated using dwi x dwj = Sijdt. Now we 
invoke the arguments found in Ref. |16| to derive lower 
and upper bounds on this expression. The upper bound is 
calculated by substituting in the maximally mixed state 
for a fixed infidelity, p-p = diag(l — A, 7^^, • • ■ , j^ri)- 



E[E[dln(A)] 



Adt-f'^plD / {D - 1) 



(10) 
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FIG. 3: (color online). The speed-up for permutation strate- 
gies for D = 4. The dashed lines are the asymptotic bounds 
in Eq. H12|) . The results for random permutation strategy are 
shown by circles for St = 6.25 x 10~*7~^ and triangles for 



St = 1.25 X 10" 
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The squares are for the deterministic 



strategy described in the text with St = 6.25 x 10 '*7 ^. 



The lower bound comes from the minimally mixed distri- 
bution for a fixed infidelty, p2 = diag(l — A, A, 0, ... , 0): 



E[E[dln(A)]]. 



(11) 



Consider the asymptotic limit A — 0. For the no- 
control case, E[(iln(A)] — —Ajt [l^. Thus the control- 
generated speed-up in measurement is bounded by 



12{D - 1) 



I) 



6 



(12) 



That is, we obtain the same Q{D'^) speed-up as for lo- 
cally optimal feedback 16[ . Once again, one can perform 
a conditional unitary at the end of the filtering to prepare 
a desired state with high fidelity. Alternatively, because 
the permutations are calculationally reversible, the high 
final fidelity implies a high confidence in the result cor- 
responding to the retrodicted eigenstate, which could be 
used for rapid readout or rapid tomography, for example. 

We confirm the bounds in Eq. ((T2|) with quantum tra- 
jectory simulation in Fig. |3l The numerically calculated 
speed-up for the random permutation strategy lies within 
the bounds derived in Eq. ([T^ . We also plot the speed-up 
for a deterministic control strategy which alternates the 
permutations P2143 and P3124. Remarkably, the speed- 
up is almost the same as that of the random permutation 
algorithm. Figure [3] also shows that, unlike the random 
unitary case, the random permutation strategy is quite 
sensitive to the frequency of the applied controls. 

We have also considered read-out of a register of qbits, 
each independently monitored as in Ref. [16| . Numerical 
results (not shown) indicate that random permutations 
in the logical basis give a similar improvement to the 
Hamming-ordered feedback scheme of Ref. [l^ . 

In summary, despite the feedback delay problem re- 
cent theoretical efforts in quantum control have been 
focused on optimal feedback control, which is particu- 
larly computationally time-consuming. In this paper we 
have demonstrated the effectiveness of combining open- 
loop control and quantum filtering to replace feedback 



control for some problems, thus circumventing the feed- 
back delay problem. In addition to this we note that the 
general strategy we have introduced is another bench- 
mark against which the performance of feedback proto- 
cols should be compared. How the speed-ups obtained 
in this Letter would be affected by the constraint of 
bounded control Hamiltonians is an open question, as 
is the application of our methodology in other systems 
and for other measurement models. 

This work was supported by ARC grant CE0348250. 
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